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Abstract 

Stationary states of stochastic models, which have N states per site, in matrix 
product form are considered. First we give a necessary condition for the existence 
of a finite M-dimensional matrix product state for any {N,M}. Second, we give 
a method to construct the matrices from the stationary states of smah size system 
when the above condition and N < M are satisfied. Third, the method by which one 
can check that the obtained matrices are vahd for any system size is presented for the 
case where M = is satisfied. The apphcation of our methods is explained using 
three examples: the asymmetric exclusion process, a model studied in [Jafarpour F 
H 2003 J. Phys. A: Math. Gen.36 7497] and a hybrid of both of the models. 

1 Introduction 

The one- dimensional many-body stochastic models have attracted much attention because 
of their rich nonequilibrium behaviours and wide applicability in condensed matter physics, 
biology and other fields. [1, 2, 3, 4] The models also have fundamental aspects: they serve 
as models of which we can inspect the behaviours and, through them, develop theories of 
nonequilibrium statistical physics. 

To study the properties of such models, there are several methods. One might start 
from doing Monte Carlo simulations to get a rough grasp about what is going on. Then 
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one might apply some approximate methods such as the mean field theory or cluster 
approximation. One might also adopt renormalization group techniques. In many cases 
these kinds of analysis give us satisfactory understanding of the models. 

In some cases, however, these methods arc not enough to fully understand the properties 
of the models. Monte Carlo results and approximations sometimes disguise the physics of 
the models. For instance in [5] it was shown that a numerically apparent phase transition 
associated with a particle condensation is not accompanied by a non-analyticity of physical 
quantities. In such cases, it would be desirable to have exact solutions of the model. 
Of course most models do not admit exact analytical treatment. But for some models, 
particularly for the ones in one dimension, one can obtain exact solutions and study the 
properties of the models in quite detail. 

In fact there is a class of models for which the exact stationary state can be written in a 
matrix product form [6]. Wc abbreviate this matrix-product stationary state as MPSS in the 
following. After the discovery of an exact matrix- product groundstate for a one-dimensional 
quantum spin chain [7], the first exact MPSS of the one-dimensional stochastic models was 
found in [8] for the asymmetric simple exclusion process(ASEP) (§3.1). It is interesting 
that numerical solutions in the matrix product form (MPF) also play an important role 
[9, 10] in the method of density matrix renormalization group (DMRG)[11] and its higher- 
dimensional extension[12, 13] through a generalisation of MPF(tensor product form). 

After [8], the MPSSs have been found for a lot of one-dimensional stochastic models. 
In addition, it is known that stationary states of stochastic Hamiltonians 

• with nearest-neighbour interaction (this is the interaction in the current paper, treated 
at (2.46)-(2.49) ) or 

• with arbitrary, but finite, interaction range 

can be expressed as infinite dimensional MPSSs(see [14] and [15], respectively). So far, 
however, it has not been known how to construct systematically the finite dimensional 
MPSS for a model at hand. One might try to find even a two dimensional matrix product 
state very hard for several days in vain. Hence, it would be desirable to have some methods 
to know 

1. whether the stationary state of the model at hand can be written in a MPF or not, 

2. if yes, how to find the matrices in the MPF. 

The objective of this article is to partially answer this question. More precisely, for the 
case where the dimensions (M) of the matrices are finite, we give 

1. for any {N,M}, a way to find necessary conditions for the existence of an exact 
M-dimensional MPSS of stochastic models which have N states per site 

2. a systematic way by which the exact concrete M-dimensional representation of the 
MPF can be constructed from the stationary states of small size system if the condi- 
tion obtained in the abovementioned step 1 is also a sufficient condition and N < M 
is satisfied 
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3. for the case M — N, the method by which one can check that the obtained matrices 
are vahd for any system size. 

This paper is organised as follows: In §2, we describe our method. Three examples are 
given in §3. The last section(§4) is devoted to the summary and a hst of possible extensions 
of our methods. 

Hereafter, we omit the word "exact" , namely, we use "a MPSS" and "a representation" 
instead of "an exact MPSS" and "an exact representation" , respectively. 

2 Method 

Let us consider a many-particle stochastic model on a chain of size L. Each site j {j — 
1, 2, • • ■ ,L) is assumed to be in one of N states which we denote as Tj{— 0, 1, 2, ... , (A^— 1)). 
For instance when = 2, = (resp. Tj = 1) may represent a state in which the site j is 
empty (resp. occupied by a particle). In this article we only consider a model in continuous 
time setting, for which the dynamics can be described by the master equation, 

pr.it) = -Hp,{t). (2.1) 

Here Pl(^) is a vector whose component represents the probability of a system in a certain 
state at time t. H is a transition rate matrix describing the stochastic dynamics of the 
model. This formulation of a stochastic model is called a quantum Hamiltonian formalism 
of the master equation because of the obvious similarity of (2.1) to the imaginary-time 
Schrodinger equation [16]. In a stationary state, to which we restrict our attention in the 
following, the left hand side of (2.1) vanishes. The stationary state vector, Pj,, of the 
model(size L) is determined by 

HPl = 0. (2.2) 

— * 

In this article, we are interested in a very special situation in which can be written 
in a matrix product form (MPF), 

p^^pMPF f^j. 2.:= 1,2,3,..., (2.3) 
where p^^^ is the vector whose component P^^^(ti, T2, . . . , tl) is defined by 

P^^'^'in^T,, . . . , r^) := -^{W\A{T,)Air2) • • • A{Tr.)\V). (2.4) 

Here {^(T)},-=o,i,...,(Ar-i) are M-dimensional square matrices with M being assumed to 
be finite. (yV\ (resp. |y)) is an M-dimensional row(resp. column) vector. is the 
normalisation constant defined by 

:= (iy|[/l(0) + AiS) + . . . A(7V - l)]^|y). (2.5) 
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We will refer to {^(0), • • • ,A{N — 1), {W\, \ V)} as "a set of matrices" for simplicity in 
the sequel. One should notice that there is a trivial freedom of a similarity transforma- 
tion for the choice of the matrices in (2.4). If one introduces another set of matrices 
{A{0),--- ,A{N-l),{W\,\V)}hy 



{W\S- 
S-^A{t)S 



A{t), (T = 0,l,---,iV-l) (2.6) 



one has 



Pr^(n, r,,..., tl) = ^{W\A{r,)A{r2) ■ • ■ A{tl)\V). (2.7) 



It is known that, Pl of some models has the MPF when some conditions of the model 
parameters are satisfied. 

In the following discussions, wc sometimes explain the main ideas using the N = 2 case, 
in which case two matrices ^4(0), A(l) are renamed as ^(0) =: E, A{1) —: D. Then the 
MPF may be written as 

- 1 , , fE\^^. , 1 , , fE\ fE\ (E 



L times 



For later use, we also define 



E 



pm,n i^w\ ( {E \V), (2.9) 



which is a conversion of the vector P]^ to a matrix form with L — m + n. Notice that the 
rank of this matrix is at most 2™''^'^"*'"^, where min{m, n} is a function whose value is the 
smaller number of m and n. 



2.1 How to find necessary conditions for the existence of an 
MPSS 

In this subsection, we give a way to find necessary conditions for the existence of an M- 
dimensional MPSS. The key observation here is that when the Pl has an M-dimensional 
MPF, the rank of a matrix p™'" obtained from Pl is no larger than M. Hence, if we 
take m and n satisfying N'^ > M, N'^ > M, the rank of the matrix P"*'" is M which is 
strictly smaller than We call this phenomenon the "rank deficiency". The rank 

deficiency occurs when the Pl has an M-dimensional MPF. In reverse, it is by this rank 
deficiency that we can find necessary conditions for the existence of an M-dimensional 
MPSS. 
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First we explain this using the case where N — M — 2,L — A. Let us consider 
equation(2.2) for L = 4 and suppose that the solution P4 has the MPF, 



1 , JE^ ®' 



We convert the vector form (2.10) into the matrix form, 



1 / p\ ®^ 

P"^" = Y,^^\d) (^Df"\^)^ (2-11) 

which is a 4x4 matrix. 

Now we show that, when M = 2, the rank of P^-^ is at most two, i.e., the rank deficiency 
of P2,2 occurs. Since {EE\V), ED\V), DE\V), DD\V)} is a set of M(= 2)-dimensional 

vectors, we can prepare two basis (column) vectors, which we call |ei), |e2). There exist 
some coefficients, (a^, 6fc}A;=i,2,3,4- such that 

EE\V) = ai\ei) +bi\e2), (2.12) 

ED\V) = a2\ei) +b2\e2), (2.13) 

DE\V) = as\ei) +bs\e2), (2.14) 

DD\V) ^a4\ei) + b4\e2). (2.15) 

Using these, column vectors in the RHS of (2.11) are 

(E\ ®^ / E\ ®^ /E\ 

EE\V)^a,{W\^^j \e,)+b^{W\^^j [e^), (2.16) 

E\ ®^ /E\ ®^ /E 



{W\\^^j ED\V)^a2{W\\^^j \e,)+b2{W\\^^j le^), (2.17) 

(E\ ®^ /E\ ®^ /'E\ 

DE\V)^as{W\i^^j \e,)+bs{W\i^^j [e^), (2.18) 



£]\ ®2 /E\ ®^ /P^ ®^ 



(W^ll^^j DD|V-)=a4(W^|(^^J |ei) + &4(W|(^^J |e2). (2.19) 

One notices that the right hand sides of (2.16)-(2.19) are written as linear combinations of 
the two vectors, 

• (2.20) 

Hence there are at most two independent vectors among the four column vectors of P^'^. 
This means that the rank of P"^'^ is at most two. The generalisation of the above argument 
to general M, N, L case is not difficult. 

One should notice that this can be used for checking the existence of a finite dimensional 
MPSS for a given model. For instance to be sure that there is no (M —)2 dimensional 
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MPSS for a given parameter set oi an N — 2 model, all one needs to do is to find a 
stationary state for L — A and see that the rank deficiency does not occur. 

Furthermore we can use this rank deficiency to find necessary conditions for the exis- 
tence of an M-dimensional MPSS. Algorithmically one performs the following steps. 

1. Solve equation(2.2) for L for which one can take m, n such that L — m + n and 

N"^ > M,N''> M. 

2. Make the N"^ x N"" matrix P'"'" from P^. 

3. Calculate the rank of the matrix P"*'". 

4. Find necessary conditions for the existence of an M-dimensional MPSS, from condi- 
tions that the rank of P"*'" is M. 

For instance, for the case where M = N = 2, L = 4, one finds P4, converts it to P^'^, 
computes the rank of it with the model parameters unfixed and looks for a condition 
where the rank deficiency occurs. If one finds a condition where the rank of P^'^ is 2, it is 
a necessary condition for the existence of an M(= 2)-dimensional MPSS. 

Note that a necessary condition found in the step 4 may not be a sufficient condition 
for the existence of a finite dimensional MPSS. In fact there occurs a different type of rank 
deficiency, caused by the existence of algebraic relations. This really happens for the ASEP 
and will be explained at the end of §3.1.1. 

In practice it is in general not an easy task to calculate the rank of a matrix with 
a lot of parameters imfixed. But if we use a computer algebra system like Maple (we 
have used Maple to perform most of the calculations in §3), it is possible to do this to 
some extent. There would be several methods to compute the rank of a matrix on a 
computer. When explaining our methods in the next section, we will adopt a version of 
Gaussian elimination procedure which consists of several elementary transformations. By 
using elementary transformations, which do not change the rank of a matrix, we transform 
pm,n jj^^Q ^ matrix as diagonal as possible so that the resultant matrix takes the form. 



Ir B 



O 



(2.21) 



where 7^, O and B represents the r x r identity matrix, an [N™- — r) x iV" zero matrix and 
an r X [N"- — r) matrix, respectively. We can tell that the rank of (2.21) is r. Thus the 
procedure for finding necessary conditions for the existence of an M-dimensional MPSS, is 
rewritten as follows. 

1. Solve equation(2.2) for L for which one can take m,n such that L = m + n and 

N"^ > M, iV" > M. 

2. Make the N"^ x A^'' matrix P'"''" from P^. 

3. Perform a set of the elementary transformations of P"*'" so that the resultant matrix 
has the form as (2.21). 
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4. Find necessary conditions for the existence of an M-dimensional MPSS, from condi- 
tions that the rank of the resultant matrix is M. 



2.2 How to construct the matrix-product stationary state 

Suppose that a necessary condition obtained by the method in §2.1 is also a sufficient 

condition for the existence of an Af -dimensional MPSS. Then, how can we find the set of 
matrices {A{0),A{1), . . .,A{N-1), {W\, \V)} in (equation(2.4)) from Pl for a finite 

number of L? We consider this problem in §2.2.1. In the subsequent §2.2.2, we comment 

— * 

on a way to check whether the obtained matrices can be used for constructing Pl for any 
system size L for the case N — M. 

2.2.1 Finding the matrices 

Again we first explain the idea for the case where N = M = 2. First thing to do is to solve 
(2.2) for L = 2, 3 and get Pl=2 and Pl=3- If the stationary state Pl can be written in the 
form as (2.4), one has 



Let us remember the freedom of the choice of matrices in (2.6) and (2.7) by a similarity 
transformation. If we introduce 




(2.22) 



(2.23) 



The matrix form P^'^ of (2.22) is 




(2.24) 



{W\S 
S-^ES 



E 



S-^DS =: D, 

with S an invertible 2x2 matrix, Z2P^'^ in (2.24) can also be expressed as 



(2.25) 




(2.26) 



Similarly for L = 3, one has 




(2.27) 
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The key of our methods is to choose S in (2.25)-(2.27) to be 

S := {E\V) D\V)) . (2.28) 

In this equation, both E\V) and D\V) are two-dimensional column vectors, so that this S 
is a 2 X 2 matrix. For this special choice of S, the following holds: 



1 
1 



I^E\V) D\V)) . (2.29) 
Using this equation (2. 2 9) and (2.26), one has 



^ f <!!:i?Y (2.30) 

\{w\d) ^ ' 

It also follows from (2.25) that 

{E D)S^S(S by (2.31) 

By virtue of this S one has 

{E D)^{E D) \V) 
^(^E{ED) D{ED)^\V) 

= [e{e\v) D\V)) D{E\V) D\V))) 

^[eS DS^ (•.• equation(2.28)) 

^S(^E 5) (•.•equation(2.31)). (2.32) 

Namely, 

{E Df^ \V) = {E D) \V) (e 5) . (2.33) 
Prom this equation(2.33), we can obtain 



{W\ 



^^""^ {E Df^'^'^ \V) = {W\ (^^y {E Df' \V) [e d) (2.34) 



for k,j = 1,2,3,.... 

An application of (2.34) for A; = j = 1 leads to 



ZaP^'' = Z2P' 



'^'^ (^E , (2.35) 
from which one obtains 



E = {Z2P''y\ZsP^'^[l : 2, 1 : 2]), (2.36) 
D = {Z2P^'^)-\Z^P^^'^[1 : 2, 3 : 4]). (2.37) 
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Here, we introduced the notation A[b : c , d : e] for a submatrix of a matrix A constructed 
by selecting the row range from the 6-th row to the c-th row and the column range from the 
d-th column to the e-th column. Now remember that Z^P^'^ and Z2P^'^ of these equations 
can be obtained by solving equation (2.2) for a small size L = 2, 3. Therefore we can obtain 

(^E from the solutions for L = 2, 3. 

It should be noted that wc need not an explicit expression of S in calculating {E,D} 
(equations(2.36) and (2.37)). S appears only in the equations from which equations(2.36) 
and (2.37) are derived. 

The case 2 ^ N < M is treated as follows. Instead of (2.28), we define the M x M 
matrix S as 

S := {E Df' \V)U, (2.38) 

where i is an integer which satisfies 2^ > M. f/ is a 2^ x M matrix by which we choose 
mutually independent M column vectors among 2^ column vectors of a matrix [E D)®^ \ V) 
so that there exists S''^. It is noted that when M = 2\l = 2, 3, 4, ... ) and M(= 2^) column 
vectors of a matrix {E D')®^ \y) are mutually independent, we can set V as the M x M 
identity matrix. 

It sometimes really happens that 2^ column vectors of a matrix {E D)®^ \ V) are NOT 
mutually independent. One of such cases is the case of the 4 dimensional set of matrices 
for the asymmetric simple exclusion process(ASEP) (§3.1). In this case of M = 2^ we can 
not use equation (2. 38) with i — 2 and U — (the four dimensional identity matrix). This 
is because only three in all four column vectors of {E D)®^ \ V) are mutually independent. 
This stems from (3.6) and the existence of the algebraic relation (3.5). For details, please 
see the last paragraph of §3.1.1. 

We should note that equation(2.31) is also satisfied in this case. Hence, as a generah- 
sation of (2.33) one has 

{E Df^^+^^ \V)U = {E Df' \V)U (^E (2.39) 
for j = £ + 1, £ + 2, . . . . Therefore 

T{W\(^^y {E Df^'+^^ \V)U ^T{W\(^^y {E D)®^ \V)U (e Dy (2.40) 
that is, 

TZk+j+iP^'^^^U = TZi^+.P'^m (e 5) (2.41) 

for j = £ + 1, £ + 2, . . . and A; = 1, 2, 3, . . . . Here T is a M x 2^^ matrix by which we 
choose mutually independent M row vectors among 2^ row vectors of a matrix Z^j^jP^'W 
in the RHS of (2.41) so that we can solve about E and D in (2.41) like (2.36) and (2.37). 
Equation(2.41) is the generalisation of (2.35). 

Generahsation to the case 2 < < M is straightforward. We define S by 

S := [a{Q) A{1) . . . A{N - l)Y\v)U, (2.42) 
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where U is a, x M matrix. In this case, from (2.6), we have 

Im = (1(0) 1(1) ...A{N- l)y]v)U, (2.43) 

where Im is the M-dimensional identity matrix. This generahses the equation(2.29). If 

N = M and aU column vectors in (^(0) A{1) . . . A{N—1)^ \V) are mutually independent, 

then we can choose i = 1 and U = (the identity matrix) in (2.42) and (2.43). Namely, 
they are simplified into the following equations: 

S := (a(0) A{1) . . . A{N - 1)) \V) (2.44) 

and 

In^[a{0)A{1) ...A(7V-l))|y), (2.45) 

respectively. 

2.2.2 Validity of the obtained matrices for arbitrary size L 

Now that we have a set of matrices {^4(0), A{1), A{N - 1),\V), {W\} by the method 
described in §2.2.1, we would hke to know whether the obtained set of matrices is valid for 
any system size L or not. It would not be difficult to check this for each small values of L 
using a computer, but this does not guarantee its validity for general L. 

In some cases, however, one can check the validity of the obtained set of matrices for any 
L. In the following discussions we assume that the following two conditions are satisfied: 

• N = M and all column vectors in (^A{0) A{1) ... A{N - 1)^\V) are mutually 
independent, where we can adopt equation(2.44) as S. 

• The total hamiltonian H has the form 

L-l 

= + + (2.46) 

i=l 

Let / denote the A^-dimensional identity matrix. Then each term in (2.46) takes the 
form, 

/i. := (g) hi^t ® (2.47) 

(2.48) 

;,(R) ^ (2.49) 

Now suppose that we have another set of matrices {Ac{0), ^4^(1), . . . , Ac{N — 1)} which 
satisfies the following three equations: 

hint fA®^] = Ac A - A Ac, (2.50) 
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{W\ 



l^) = A,|l-), 



(2.51) 
(2.52) 



where A and A^. are defined as 



/ 4(0) \ 

A{1) 
\A{N - 1)J 



I ^c(O) \ 



and Af. 



^c(i; 



\MN - 1)) 



(2.53) 



respectively. Then we can show that the MPF constructed from the set of matrices 
{A{Q),A{1), . . .,A{N - 1), \V), {W\} according to (2.4) solves equation(2.2) for any size 
L. This is due to the so-called cancellation mechanism[17, 18, 19]; all terms in HP^^^ — 
h{^)pMPF ^ ^^pupF ^ ^(R)^MPF cancelledj)ut by (2^50)-(2.52)._ 

A good property of our set of matrices {A(0), A{1), .... A{N — 1), {W\, \V)} enables 
us to compute easily a candidate for {Ac{0) , Ac{l) , . . . ,Ac{N — 1)} in the case N — M. 
Namely, we can calculate {Ac{0) , Ac{l) , . . . , ^c(-^ ~ 1)} from the formula 



/ ^(0) \ 
A{1) 

\a{N - 1) J 



+ E{h^,[A^']]\V), 



(2.54) 



where we denote a transpose of a matrix A, by *A and is the operator which transforms 
an A^^-dimensional vector * (Si, S2, . . . , Bj^2) —: B[A^^] into 



Bn+1 
B2N+1 



B2 

Bn+2 



Bn 
B2N 



This operator satisfies S {B[N^] + C[N^]} = E {B[N^]}+E {C[N^]} and E {B[N] C[N]} -- 
BIN] (^*C[N]. It is noted that the argument of the LHS of the latter is a vector with N"^ 
components. 

Derivation of (2.54) is as follows. By virtue of (2.45) (the good property of our set of 
matrices), we can derive from (2.52) 



We perform S{ equation(2.50)}|y) to get 



mt 



A(8) A 



\v). 



(2.55) 



(2.56) 
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Using (2.45), (2.55) and a relation {A (^B)\V)^A^ (^1^)), the RHS of (2.56) is 



'A\V) 



7^f- A®*/i«. 



(2.57) 



This results in the formula (2.54). 

Once a candidate for the set of matrices {A, Ac, \V), {W\} is obtained from (2.54), we 
must check whether the candidate satisfies equations(2.50)-(2.52). If these equations hold, 
it means that the obtained set of matrices is valid for any L. 

So far we have not succeeded in extending the formula (2.54) to the case N ^ M. This 
is an open question. 



3 Examples 

In this section, the application of our methods in §2 is illustrated by performing explicit 
calculations for three models: 

1. the asymmetric exclusion process(ASEP) [6, 20, 21, 22, 23, 24, 16, 25] (§3.1), 

2. the model studied in [26] (§3.2), 

3. a hybrid of the model(l) and the model(2)(§3.3). 

For the first two models, it is already known that there exist MPSSs for special values of 
the model parameters. We will see that the conditions and the matrices can be reproduced 
from our methods. For the third model, we apply the same methods and find a MPSS, 
which was unknown. 



3.1 The asymmetric simple exclusion process (ASEP) 

In this subsection, we treat the asymmetric simple exclusion process(ASEP) . The model 
is defined on the one-dimensional lattice whose size is L. Each site can take two states: 
a site is either empty or occupied by a particle. The time of the model is continuous one 
(i.e. the random sequential update). A particle in the bulk hops to the left (resp. right) 
neighbour site with a rate pl (resp. pr) if the left (resp. right) neighbour site is empty. A 
particle at the rightmost site is removed with a rate 13 if the site is occupied by a particle. 
At the leftmost site, a particle is injected with a rate a if the site is empty. 

The total hamiltonian H of this model has the form in (2.46)-(2.49). For the case of the 
ASEP, h^^^ of (2.48) and /i^"") of (2.49), which express the left and right boundary condition 
respectively, are 

-a 



and h^'^ :-- 



-p 

/3 



(3.1) 
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in a basis of states whose order is (|0), |A)). The interaction hamiltonian h^t of (2.47) is 
defined as 





mt 










Q 

-Q 





-1 
1 











(3.2) 



in a basis of states whose order is (|00), |0A), |A0), |AA)). In (3.2), we have introduced the 
parameter q :— Pl/pr and set pr = 1. In the following, we assume that a > 0, (3 > 0,q > 0. 



3.1.1 Determination of the necessary condition for the existence of an M- 
dimensional MPSS — a case of the ASEP — 

Let us find a necessary condition for the existence of the M{= 1, 2)-dimensional set of ma- 
trices {E, D, \V), {W\}. We perform the following calculations according to the procedure 
in §2.1. First, we obtain P^'^(for its definition, see equation (2. 9)) by solving equation(2.2) 
for the (L =)4-site system. Next we perform a set of elementary transformations so that 
the resultant matrix has the form in (2.21). For the present case, the resultant matrix is 



1 







1 -2±^ 
1 





^ -l+f3+q 



(/asepi 7^ and /asep2 0) 



/3 

























1 n i-l+H+qfl 
^ /3(9+/3) 



1 





-2q-l3W+l3q 






13^ 





{-1+0+qfq 
(-l+/3+g)(2g+/3) 

P{q+I3) 






(/asepi = 0) 



(3.3) 



(/asepi 7^ and /asep2 = 0) 



where /asepi := q + a + 13 - I and /asep2 := + g (a + /5 - 1) + al3. From (3.3), 
we can see that the rank of P^'^ is 1 when /asepi = 0. So /asepi = is the necessary 
condition for the existence of an M{— l)-dimensional MPSS. According to [20, 21, 22, 23], 
this condition is the true one. We can also see that the rank of P^'^ is 2 when /asep2 = 
and /asepi from (3.3). So this condition is the necessary condition for the existence of 
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an M{— 2) -dimensional MPSS. This is also true according to the reference[20, 21, 22, 23]. 
In the next §3.1.2, we try to find a two-dimensional set of matrices by using /asep2 = 0. 
That is, we use 

-qiq-l + P) 



a = fl'A(g,/?), where gA{q, P) ■-- 



(3.4) 



Here we describe the rank deficiency which happens for the ASEP due to the existence 
of the algebraic relations, such as 



DE - qED (x{E + D) 



(3.5) 



and 



D\V) oc \V). (3.6) 

These equations can be shown to be satisfied using (3.2) , (2.50) , (2.52), (3.1) and (3.12). 
Because of (3.5) and (3.6), the rank of P^'^ is at most 3 (cf. (3.3)). More generally, the 

rank of {W\Q^\e Df^\V) {k = 2,3,4,...) is also at most 3. It should be noted 
that, generally, not only the existence of an MPSS but also an algebraic relation between 
matrices in the MPSS could cause a rank deficiency. 



3.1.2 Construction of the (M =)2-dimensional set of matrices — a case of the 
ASEP— 

Let us find the (M =)2-dimensional representation of the MPSS of the ASEP. In the 

following, we use expressions for which we have eliminated a by using (3.4) . 

Firstly, we calculate {E,D}. We solve equation(2.2) for L — 2 and transform the 
solution into the matrix form P^'^ : 



1 



/32 



Prom this equation, we define {Wi\ and {W2\ by 



(3.7) 



We solve equation(2.2) also for L = 3 and transform the solution into the matrix form 

pl,2. 



1 



gA(g./3) (g+(?/3+/3^)gA(g,/3) gA{q,Pf 

13 /3(g+/3) /32 

(g^+2g2/3+3g/3^+/3'^)gA(g,/3) (g+g/3+/3^)gA(g,/3)^ {q^l3+2ql3^+q+l3'^)gA(q,l3f gA{q,f}f 
{q+PfP <^+PW {q+PW 



From (2.36) and (2.37), we can obtain E and D: 



E 



"iq+fS gA{q,l3) 
q+J P 




g-l+/3 



and D — 



q + f3 
(3 1 
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Secondly, we calculate {{W\, \ V)}. For \V), we can use 



or 



E\V), 



D\V) 



(3.8) 



(3.9) 



which are the left and right half of (2.29), respectively. If det(£') — q/{q + P) 0, we can 
obtain \V) by (^)~HJ). Or, if det(5) = q'^{q- 1+ PY/{P^{q + P)) ^ 0, we can obtain \V) 

by (5)-i(J): \V) = [e] (J) = [d] (J) = ( % ). Under the same condition. 



yet {W\ by 



or 



{Wi\ = {W\E, 



{W2\ = {W\D, 



we can 



(3.10) 



(3.11) 



which can be shown from (3.7) and (2.30). Thus {W\ = {Wi\{E)-^ = {W2\{D)-^ = 



1 gA{g,l3) 
' 



At this point, we should check that p^^^ (see (2.4)) calculated by our 
{E, D, {W\, \ V)} is also the solution of (2.2) for any size L. For this check, it is adequate 
that there exist Ec and Dc which satisfy equations(2.50)-(2.52). Using the above-mentioned 
result, we obtain a candidate for {E^ Dc} by (2.54) 



-Ec^Dc^gA{q,f3) 



1 
1 



(3.12) 



It is easy to show this {EcD^} satisfies equations(2.50)-(2.52). Therefore, it is not only a 
candidate but also the true {Ec,Dc}. 

We comment on the relation between the known set of matrices and ours. The known 
two-dimensional matrices, {E, -D}[20, 21, 22, 23], which we denote {E\, -Da}, are given by 



E, 



' 1-9 

<jA{q,0) 
1 





ll-'')(l + 5xfe) 



and Da '■- 



The relation between {E^, D^} and {E, D} is 



5) 94q,(3) 



Ea 
Da 



where Sa 



(i-?)(i + i 



i-g i-g 

9A{q,P) 13 

1 



(3.13) 



and c is a free parameter. This Sa exists when det S'a = — 7^ is satisfied. More- 

over, our result (3.12) corresponds to the result in the reference[20, 21, 22, 23]. This 
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is because {E^,D^} defined as {^\) := 'S'a(^^) (Sa) ^ gl^ql) type of (a scalar) x 

(the two-dimensional identity matrix). 

Furthermore, we have checked that there exists relations like (3.13) between our (M = 
)3, 4-dimensional sets of matrices which are obtained by the method in §2.2.1 and the sets 
of matrices in the reference[21, 22, 23]. 



3.2 The model in [26] 



The model treated in this subsection is the one studied in [26]. It is defined on the 
one-dimensional lattice which has L sites. Each site can be either empty or occupied 
by a particle. The time evolution of the model is continuous(i.e. the random sequential 
update). Between nearest neighbour sites of the chain, there stochastically occur three 
types of processes: diffusion, coagulation and decoagulation. The rate of each process is 



+ A^A + 



A + 
A + A 
A + A 



rate:g 



rate;g 



rate:q 



^0 + A 
A + 
^0 + A 



(diffusion) 



(coagulation) 



. rate:Ag . . 

+ A ^ A-fA 



A + 



rate:Ag 



A + A 



(decoagulation). 



where A and represent a particle and an empty site, respectively. At the leftmost site, 

a particle is injected with a rate a if the site is empty and removed with a rate (3 if the 
site is occupied. This model has a reflective boundary condition at the rightmost site. 
In the following, we assume > 0, a > 0, /3 > 0, A > 0, although there exists a (four- 
dimensional) MPSS, which we do not treat in this paper, also in a case with a — (3 = 0[19]. 

The total hamiltonian H of this model takes the form in (2.46)-(2.49), where /i^^^ and 
h^^"^ are given by 

^ a ^ 

and h^'^ 



-a 



P 








(3.14) 



in a basis of states whose order is (|0), |A)), and the interaction term hint is defined as 



^int ■ — 





{1 + A)q 

-q 

-Aq 





1 1 

Q 



Q 

1 + A 



1 



(3.15) 
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in a basis of states whose order is (|00), |0A), |A0), |AA)). It is noted that the overall signs 
of (3.14) and (3.15) are opposite to the ones in [26]. 



3.2.1 Determination of the necessary condition for the existence of an M- 
dimensional MPSS. — a case of the model in [26] — 

Let us find a necessary condition for the existence of the (M =)2-dimensional set of matrices 
{E,D, \V), {W\}. According to the procedure in §2.1, we solve equation(2.2) for L = 4 
and obtain the four dimensional square matrix P^'^(for its definition, see equation(2.9)). 
We perform a set of elementary transformations so that the resultant matrix has the form 
in (2.21). The resultant matrix is 

r 1 

< 1 g2 A 

^ |_ 

where I4 is the four dimensional identity matrix and /j := A/3q + A — qa — q^A. In the 
process of transformation to obtain (3.16), two "big" polynomials, each of which has more 
than 493 terms, appear chiefly in factors of numerators of the diagonal elements. It seems 
very unlikely that these polynomials contain important information about the existence of 
a MPSS. Hence we assume that these polynomials can not vanish, so that we can divide 
by them. From (3.16), we can tell that the rank of P^'^ changes from 4 to 2 when /j = 0. 
This condition, /j = 0, can be rewritten as 

« = ^j(g,/3,A), where ^j(g, /3, A) := (1/g - g + /3)A. (3.17) 

In the next §3.2.2, we assume this condition (3.17) holds. 



ih = 0) 



(3.16) 



3.2.2 Construction of the (M =)2-dimensionaI set of matrices 
model in [26] — 



-a case of the 



Let us find the (M =)2-dimensional representation of the MPSS of the model. Because 
calculations we have to perform here are quite similar to §3.1.2, we mainly focus on sum- 
marising the results, for which we have eliminated a using (3.17). The set of matrices of 
this model is 



E 



1 





1 



and D — 




1 




A 

7^ 



1^) 



and {W\ 



if A^ 

^j(g,/g,A) 
/3 



gj(g,AA) 

/5 
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The candidates for Ec and Dc which can be obtained from (2.54) are 








and Dr — —Ec. 



It is easy to check that these also satisfy equations(2.50)-(2.52). Therefore, they are the 



true Ec and D^.. 



3.3 A hybrid model 

In this subsection, we treat a model similar to the one in §3.2. The only differences are 
boundary conditions. The boundary conditions of the model treated here are the same as 
those of the model in §3.1. Therefore the total hamiltonian H of this model is defined by 
(2.46)-(2.49) where /i^ and /i^ are the same hamiltonians as those defined in (3.1), and the 
interaction hamiltonian hi-^t is the same as that of the model in [26] (except an overall sign) 
and is given by (3.15). In the following calculations, we assume g > 0, a > 0, /3 > 0, A > 0. 



3.3.1 Determination of the necessary condition for the existence of an M- 
dimensional MPSS — a case of a hybrid model — 

Let us find a necessary condition for the existence of the (M =)2-dimensional set of matrices 
{E,D,\V).(W\}. Wc perform the following calculations as in §3.1.1 according to the 
procedure in §2.1. We solve equation(2.2) for L = 4 and obtain the four dimensional 
square matrix P^'^. The resultant matrix after a set of elementary transformations is 

'h (/hyv^O) 

r 1 

< 1 g(g + /3) A 

^ |_ 

where 1^ is the four dimensional identity matrix and /hy := —A + g^A + qa. As in §3.2.1, 
in the process of transforming to (3.18), two "big" polynomials, each of which has more 

than 501 terms, appear chiefiy in factors of numerators of the diagonal elements. We again 
assume that these polynomials can not be zero, so that we can divide by them. From 
(3.18), we can tell that the rank deficiency occurs(the change of the rank is 4 to 2) when 
/hy = 0. We regard the condition, /hy = 0, as a necessary condition for the existence of 
an M{— 2) -dimensional MPSS. For use in the next §3.3.2, we transform /hy = into the 
following form 

A (1 - g2) 

« = 5'hy(?,A) where g'hy(?,A):= . (3.19) 



(/hy = 0) 



(3.18) 
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3.3.2 Construction of the (M =) 2- dimensional set of matrices — a case of a 
hybrid model — 

Let us find the (M =)2-dimensional representation of the MPSS of the hybrid model. 
Because calculations we have to perform here are quite similar to §3.1.2, we mainly focus 
on summarising the results, for which we have eliminated a by using (3.19). The set of 
matrices of this model is 





" g2 " 
1 

-A ^ . 









D = 


_q{q + P) A 











\V) = 


I Aq J 


{W\ = 


1 



ghy(9,A) 





And candidates for Er and Dr are 



-E, = L'e = 







(3.20) 



We have checked that these candidates for Ec and Dc satisfy equations(2.50)-(2.52), so 
that (3.20) represents the true Ec and Dc- 



4 Summary 

In this paper, we have given a systematic way to find and construct exact finite dimensional 
matrix product stationary states for one-dimensional stochastic models which have N states 
per site. More precisely, we have explained (§2): 

1. a systematic way to search necessary conditions for the existence of an exact M- 
dimensional matrix- product stationary state (MPSS) (§2.1), 

2. a systematic way by which the exact M(> A^)-dimensional representation of the 
the matrix product form(MPF) can be constructed from the stationary states of the 
small L if the necessary condition obtained in the abovementioned step 1 is also a 
sufficient condition for the existence of an M-dimensional MPSS (§2.2), 

3. a systematic way to check the validity of the obtained MPSS for an arbitrary system 
size in the case N = M(§2.2.2). 

After giving the general ideas, we have presented three examples to which our methods 
can be applied (§3): 

1. the asymmetric exclusion process(ASEP) [6, 20, 21, 22, 23, 24, 16, 25] (§3.1) 

2. the model in [26] (§3.2) 

3. a hybrid of 1. and 2. (§3.3) 
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For the first two models, we have reproduced the known finite dimensional MPSSs. For the 
hybrid model, we have found a new MPSS by our method. This clearly shows a potential 
power of our method to find exact MPSSs for a large class of one-dimensional stochastic 
models. 

Although we have treated only exact MPFs in this paper, we can also show the way 
how to construct numerically exact MPF for more generic cases where calculations are so 
tedious that the computer algebra system (for example. Maple) is not Tiscful (this method 
will be published elsewhere). It should also be noted that we have treated uniform MPFs 
in this paper, although non-uniform MPF can be made numerically, for example, by the 
DMRG[11]. 

Finally we would like to mention possible extensions of our methods. First step is 
to remove a restriction(A^ = M) on applicability of our mcthods(§2). This step helps 
to develop the applicability of our methods to various kinds of models(e.g. models with 
periodic boundary conditions; quantum spin chains) and also to develop the numerical 
renormahzation(for example, the DMRG[11]) to stochastic models. [27, 28, 29, 30, 31, 32, 
33, 34] 
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Note added. After the completion of writing the manuscript, we noticed that our results 
for the hybrid model, i.e., the condition (3.19) and the two-dimensional set of matrices, 
have already been derived in [35] and [36] respectively. They were, however, new when 
they were discovered and hence we did not change the original presentation of this article. 
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